Cross-over and bypass configurations for high-speed data transmission

ABSTRACT

Circuits, methods, and apparatus that may improve networking techniques for transferring data among various electronic devices. One example may provide sharing data among various devices by daisy-chaining devices together. That is, several devices may be connected to each other through a series of cables to form a chain of devices. In this physical configuration, data may be shared among multiple devices using a series of single-hop virtual tunnels. Alternatively, a number of tunnels may be formed by a host device, each having a target device in the daisy chain. Each tunnel may originate at the host device and terminate at their target device. Each tunnel may bypass devices between the host device and the tunnel&#39;s target device. These two techniques may also be combined. Another example may provide a method of simplifying the routing of high-speed data signals through a network topology.

CROSS-REFERENCES TO RELATED APPLICATIONS

This application is a divisional of U.S. patent application Ser. No.13/403,182, filed Feb. 23, 2012, which claims the benefit of U.S.provisional patent application No. 61/446,027, filed Feb. 23, 2011,which are hereby incorporated by reference.

BACKGROUND

Computing environments are becoming increasingly complex. One reason isthat computing tasks are becoming more complicated. Another is thatextremely high-quality, specialized computing devices are becomingpopular.

These ever increasingly complicated tasks have driven a recentevolutionary change to many people's computer systems, specifically, theinclusion of multiple display screens. For example, an electronicengineer may use one display to show a schematic of a portion of anelectronic device and another display to show a layout of that portionof the electronic device. Also, these complicated tasks have led toincreases in the amount of data that needs to be stored. In particular,video applications may be capable of generating huge amounts of data. Inresponse, external hard drives have become a popular way to store thisdata.

The availability of specialized devices has also acted to increase manyuser's computing environments. For example, laptop computers have becomeso powerful that for many, they are not only a portable computingdevice, but have taken over duties as a desktop computer as well. Butoften times, perhaps at work or at home, users may want a bigger screenthan a laptop may provide. In such a case, a larger, external displaymay be used. Also, a laptop may have a limited storage capacity. This,and a desire to perform backup tasks, may prompt a user to add anexternal storage drive.

To share data, these devices need to connect to each other, eitherthrough cables, wirelessly, or by using other means. When connectingthese devices through these cables, it may be useful to be able tooptimally utilize the bandwidth available at these connections.

Thus, what is needed are circuits, methods, and apparatus that mayimprove networking techniques for transferring data among variouselectronic devices.

SUMMARY

Accordingly, embodiments of the present invention may provide circuits,methods, and apparatus that may improve networking techniques fortransferring data among various electronic devices.

An illustrative embodiment of the present invention may provide sharingdata among various devices by daisy-chaining devices together. That is,several devices may be connected to each other through a series ofcables to form a chain of devices. For example, a host device, such as alaptop, may connect to an external display through a first cable, whilean external storage drive may connect to the display through a secondcable. Data on these cables may be received by, and transmitted by,router chips or other appropriate devices. This configuration allows thehost device, the laptop, to display graphics images on the display andto store data in the external drive.

With this physical connection, data may be shared among these devices ina number of ways. That is, various virtual connections may be configuredgiven a set physical connection. Each virtual connection from one deviceto another may be referred to as a hop. A tunnel may be used to conveydata from one device to one or more other devices, which may be referredto as destination devices. A tunnel may be one hop in length, or it maybe multiple hops in length. A device where a tunnel terminates may bereferred to as a target device.

In a specific embodiment of the present invention, data may be sharedamong multiple devices using a series of single-hop tunnels. Thistechnique may provide for potentially very long daisy chains of devicesat the cost of an increase in latency through the chain.

In another specific embodiment of the present invention, a number oftunnels may be formed by a host device. These tunnels may each have atarget device in the daisy chain. Some of these tunnels may be multiplehops in length. Each tunnel may originate at the host device andterminate at their target device. Each tunnel may bypass devices, ifany, between the host device and the tunnel's target device. Thistechnique may reduce latency, but the length of a resulting daisy chainmay be limited by the number of tunnels that may be formed by the host.In various embodiments of the present invention, the number of tunnelsthat may be formed by a host device may be limited by a number ofavailable hardware resources. For example, a number of adapters for aparticular protocol in the host device may limit the number of tunnelsthat may be formed.

In another specific embodiment of the present invention, these twotechniques may be combined. For example, a number of tunnels may beformed by a host device, where each tunnel carries data for multipledestination devices. Each tunnel may originate in the host device andterminate in a target device. Each tunnel may bypass intermediatedevices between the host device and their target device. A series ofsingle-hop tunnels may then convey data from the target device to thetunnel's other destination devices.

Another illustrative embodiment of the present invention may provide amethod of simplifying the routing of high-speed data signals through anetwork topology. In one example, a device may include two routerdevices. These router devices may be cross-coupled to connectors thatmay be connected to other electronic devices further down the daisychain. By cross coupling these connectors, it does not matter whichconnector a downstream device connects to, the same data may appear onthe same connector pins. Also, by cross-coupling these connectors, datamay pass through a device having two router devices without that datahaving to be passed from one of the router devices to the other.

Various embodiments of the present invention may incorporate one or moreof these and the other features described herein. A better understandingof the nature and advantages of the present invention may be gained byreference to the following detailed description and the accompanyingdrawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a computer system that may be improved by theincorporation of embodiments of the present invention;

FIG. 2 illustrates a connection topology among router devices accordingto an embodiment of the present invention;

FIG. 3 illustrates a connection topology among routers according to anembodiment of the present invention;

FIG. 4 illustrates a connection topology among router devices accordingto an embodiment of the present invention;

FIG. 5 illustrates a network topology where an electronic deviceincludes two router devices according to an embodiment of the presentinvention; and

FIG. 6 illustrates another network topology where a device includes tworouter devices according to an embodiment of the present invention.

DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS

FIG. 1 illustrates a computer system that may be improved by theincorporation of embodiments of the present invention. This figure, aswith the other included figures, is shown for illustrative purposes anddoes not limit either the possible embodiments of the present inventionor the claims.

This figure includes host device 110, first electronic device 120, andsecond electronic device 130. In this example host device 110 is alaptop computer, while the first electronic device 120 and the secondelectronic device 130 are an external display and a hard drive. In otherembodiments of the present invention, other types of devices may beconnected together. Host device 110 may communicate with firstelectronic device 120 over cable 140. First electronic device 120 maycommunicate with second electronic device 130 over cable 150. In variousembodiments of the present invention, cables 140 and 150 may be varioustypes of cables. In a specific embodiment of the present invention,cables 140 and 150 may be Thunderbolt cables, though in otherembodiments of the present invention, cables 140 and 150 may beDisplayPort cables, or other types of cables.

In various embodiments of the present invention, data may be transmittedand received over cables 140 and 150 using various types of circuitry.For example, router device or chips may be used to transmit and receivedata over cables 140 and 150. A specific example of such a router deviceor chip may be the “Light Peak” developed at least in part by IntelCorp. of Santa Clara, Calif., though in other embodiments of the presentinvention, other types of router devices or chips may be used.

In a specific embodiment of the present invention, various types of datamay be transmitted over cables 140 and 150. For example, DisplayPort orPCIe data may be transmitted using Thunderbolt packets over cables 140and 150. In other embodiments of the present invention, other types ofdata formatted in other ways may be transmitted over cables 140 and 150.

In this example, cable 140 may carry data transmitted from host device110 to first electronic device 120 and second electronic device 130.Cable 150 may carry data from first electronic device 120 to secondelectronic device 130. Similarly, cable 150 may carry data transmittedfrom second electronic device 130 to first electronic device 120. Cable140 may carry data transmitted from first electronic device 120 to hostdevice 110.

Once these physical connections are set, the virtual communicationchannels used to convey this data may be configured in various ways. Forexample, data may be transmitted over cables 140 and 150 using a seriesof one hop tunnels. This may provide an advantage in that very longdaisy chained may be achieved. This long or large fanout, however, maycome at the expense of increased latency. An example is shown in thefollowing figure.

FIG. 2 illustrates a connection topology among router devices or chips(RCs) according to an embodiment of the present invention. In thisexample, each router chip may include a PCIe switch and a Thunderboltswitch. Each PCIe switch may have a number of adapters associated withit, which may form Thunderbolt tunnels for transmitting data. EachThunderbolt switch may terminate a tunnel and provide PCIe data to itsassociated PCI switch. In various embodiments of the present invention,each Thunderbolt switch may also receive and transmit DisplayPort data,though these paths are left off these figures for clarity.

This figure illustrates a host device 210 connected to first device 220over first cable 240, and second device 230 connected to first device220 over second cable 250.

In this example, host device 210 may transmit data A to first device 220and data B to second device 230. Accordingly, host device 210 may form afirst tunnel (A,B) to carry data A to first device 220. The first tunnel(A,B) may be formed at a PCIe adapter associated with the PCIe switch inhost device 210. The first tunnel (A,B) may terminate at a Thunderboltswitch in first device 220. Data A,B may be provided to itscorresponding PCIe switch. The PCI switch may provide data A tocircuitry coupled to the router chip in first device 220. An adapterassociated with the PCIe switch may form a second tunnel (B). Secondtunnel (B) may be conveyed using second cable 250 to second device 230.Data B may be provided through a corresponding PCIe switch to othercircuitry in second device 230.

In a specific embodiment of the present invention, each Thunderboltswitch may be able to route data received from a first cable directly toa second cable. In this way, a data path may bypass a PCIe switch in arouter device and avoid its attendant format changes. This may reducethe overall latency through a chain of devices. An example is shown inthe following figure.

FIG. 3 illustrates a connection topology among routers according to anembodiment of the present invention. In this example, host device 310may communicate with first electronic device 320 through first cable340, while second device 330 may communicate with first device 320through second cable 350.

As before, host device 310 may transmit data A to first device 320, anddata B to second device 330. Accordingly, data A and B may be receivedby the PCIe switch in host device 310. Adapters associated with thisPCIe switch may form separate tunnels for data A and data B. These twotunnels may convey data using first cable 340 to first device 320.Tunnel (A) may terminate and data A may be provided by the PCIe switchto associated circuitry in first device 320. Tunnel (B) may bypass thePCIe switch and exit the Thunderbolt switch on second cable 350. In thisconfiguration, tunnel (A) may be one hop long and tunnel (B) may be twohops long. Tunnel (B) may terminate at the Thunderbolt switch in seconddevice 330, and data B may be provided by the associated PCIe switch tocircuitry in second device 330.

In this way, the latency of data B may be reduced by bypassing the PCIeswitch in first device 320. However, the number of tunnels may belimited by hardware resources in host device 310. For example, if anumber of PCIe adapters that can tunnel PCIe data is limited to four,the maximum fanout from host device 310 is also four. Accordingly,embodiments of the present invention may provide a mix of the above totechniques. In this way, latency may be reduced, while maintaining longor large fanouts. An example is shown in the following figure.

FIG. 4 illustrates a connection topology among router devices accordingto an embodiment of the present invention. In this example, host device410 may communicate with first electronic device 420 through first cable440, second device 430 may communicate with first device 420 throughsecond cable 450, while third device 460 may communicate with seconddevice 430 through third cable 470.

In this example, host 410 may transmit data A to first device 420, dataB to second device 430, and data C to third device 460. A first adapterin host device 410 may form a first tunnel for data A, and a secondadapter may form a second tunnel for data B and C. Tunnels (A) and (B,C)may be conveyed using first cable 440. Tunnel (A) may terminate in firstdevice 420 and data A may be provided through its PCIe switch toassociated circuitry.

Tunnel (B,C) may bypass the PCIe switch in first device 420 and exit theThunderbolt switch on second cable 450. This may allow data B and C toavoid the latency incurred with the PCIe switch in first device 420.Tunnel (B,C) may terminate in second device 430. In this way, tunnel(B,C) may be two hops long. Data B may be provided by the PCIe switch insecond device 430 to circuitry in second device 430. Tunnel (C) may beformed and provided on third cable 470, where it may be received bythird device 460. The PCIe switch in third device 460 may provide thisdata to associated circuitry.

Again, in this example, data B and C may avoid the latency of a PCIEswitch. Also, only the resources of two adapters in host device 410 areused transmit data to these three external devices. This tradeoff mayhelp reduce latency while providing good fanout.

Devices consistent with various embodiments of the present invention mayutilize multiple router devices. For example, some electronic devicesmay include two router chips or devices, though other devices mayinclude more than two router chips or devices. When two or more devicesare included, a first router device may be used to receive and providedata for the electronic device housing the routers, while a secondrouter device may be used to send data to other electronic devicescoupled downstream. To facilitate this, connector receptacles connectedto the router devices may be cross coupled. This arrangement may allowmultiple, high-bandwidth signal paths to use separate lanes, which mayavoid bandwidth limitations that may otherwise result from sharing asingle lane. An example is shown in the following figure.

FIG. 5 illustrates a network topology where an electronic deviceincludes two router devices according to an embodiment of the presentinvention. This figure includes host device 510, first electronic device520, and second electronic device 530. First electronic device 520 maybe connected to host device 510 through a single tethered cable 540.That is, tethered cable may be dedicated to first electronic device 520in that conductors in cable 540 attach to circuitry or other componentsinside first electronic device 520, as opposed to connecting to firstelectronic device 520 through a connector in an enclosure of firstelectronic device 520. Second electronic device 530 may be connected tofirst electronic device 520 through cable 550. In this example, thefirst electronic device 520 may be a display device.

Again, in this example, host device 510 may be connected to firstelectronic device 520 through tethered cable 540. This tethered cablemay carry two lanes of data. A first lane of data may carry data A and Xfrom connector 512 to a first router chip or device 524 in firstelectronic device 520, while a second lane may carry data B fromconnector 512 to second router chip or device 526 in first electronicdevice 520. Physically, these lanes may be specific wires in tetheredcable 540. They may terminate at one end at specific pins or contacts inconnector 512. In practical applications, connector 512 may be acomposite of a connector insert attached to an end of tethered cable 540and a connector receptacle in host device 510. The lanes may be assignedto specific pins or contacts in the connectors.

Again, in this example, host 510 may transmit PCIe data A andDisplayPort data X to first electronic device 520, and PCIe data B tosecond electronic device 530. Accordingly, host device 510 may providedata A and X to a first lane defined by pins of connector 512 and data Bto a second lane of connector 512. First router chip 524 may providePCIe data A and DisplayPort data X to associated circuitry in firstelectronic device 520. (It should be noted that in these examples,associated circuitry is connected to the top router device or chip, suchas router device 524, and is not directly connected to the lower routerdevice or chip, such as router chip 526.) Second router chip or device526 may provide data B to connector 522. Second electronic device 530may receive data B through cable 550 and connector 532. In this example,data B may pass through electronic device 520. That is, data B may notneed to be passed from router device 524 to router device 526. This mayhelp reduce the latency of data B and saves power. It should also benoted that it does not matter which connector of second electronicdevice 530 that cable 550 is connected to. If cable 550 is connected tothe lower connector receptacle, routing device 526 could be configuredto deliver data B to that connector.

This arrangement may also be useful in load-balancing where twoDisplayPort or other high-bandwidth signals are received by anelectronic device, since each signal may be assigned to a separate laneand each routing device may handle one of these high-bandwidth signals.An example is shown in the following figure.

FIG. 6 illustrates another network topology where a device includes tworouter devices according to an embodiment of the present invention. Thisfigure includes host device 610, first electronic device 620, thirdelectronic device 630, and fourth electronic device 660. As before,first electronic device 620 may couple to host device 610 throughtethered cable 640. Second electronic device 630 may couple to firstelectronic device 620 through tethered cable 650. Third electronicdevice 660 may couple to second electronic device 630 through cable 670.In this example, first electronic device 620 and second electronicdevice 630 may be display devices.

In this example, host device 610 may transmit PCIe data A andDisplayPort data X to first electronic device 620, DisplayPort data Y tosecond electronic device 630, and PCIe data B to third electronic device660. Accordingly, host device 610 may provide data A, B, and X to afirst lane on connector 612, and data Y on a second lane of connector612. First routing device 624 in first electronic device 620 may providePCIe data A and DisplayPort data X to internal circuitry. First routingdevice 624 may further provide data B to a second lane of connector 622.Second routing device 626 may provide data Y to a first lane onconnector 622.

Second electronic device 630 may receive data Y and provides it tointernal circuitry. Second routing chip 636 may provide data B to afirst lane on connector 632. Third electronic device 660 may receivedata B.

In this example, host device 610 may provide two high-speed data signalsX and Y. In this configuration, these high-speed signals may useseparate lanes and separate routing chips. Again, this may help reducelatency, and may also help balance the bandwidth load among the variouscircuits.

More specifically, in this example, data X and Y may be DisplayPortsignals, though in other configurations, they may be other types ofdata. These signals may consume a great deal of bandwidth, so much sothat in some embodiments of the present invention, data X and Y may notbe able to share a data lane. That is, the bandwidth requirements ofdata X and Y may exceed the bandwidth capacity of a single lane.Accordingly, this configuration allows data X to share a lane with dataA and B, which may be lower bandwidth signals, while providing aseparate lane for data Y. By allowing data X to have its own laneseparate from data Y, host device 610 may provide DisplayPort data tofirst electronic device 620 and second electronic device 630.

As can be seen in this example, the cross coupling router chip outputsat the connectors of first electronic device 620 and second electronicdevice 630 may allow the high-bandwidth data signals X and Y to berouted using separate lanes. For example, since data Y is not used byfirst electronic device 620, it may be provided by host device 610 on asecond lane that is received over tethered cable 640 by routing chip626. Routing device or chip 626 may then provide data Y on a first laneto either connector 622 or 623, depending on where cable 650 isinserted. By providing data Y on this first lane, data Y may be receivedby router chip or device 634 in second electronic device 630, which mayprovide it to associated circuitry, as shown.

It should be noted that without cross coupling, router chip 626 in firstelectronic device 620 may provide data Y on the second lane with data B,such that data Y would be received by routing device or chip 636. Inthis case, routing chip 636 would have to provide data Y over connection635 to routing chip or device 634, which would then provide data Y tothe associated circuitry. This extra jump over path 635 may add latencyto data Y, consume extra power, and also slow the transmission of dataB.

It should also be noted that the benefit of this configuration arisesindependently of the connector on the first electronic device that thetethered cable 650 is connected to. Specifically, if tethered cable 650is connected to connector receptacle 623, then routing device 626 infirst electronic device 620 may provide data Y to routing device 634 insecond electronic device 630 via connector receptacle 623.

In various embodiments of the present invention, various connections maybe made among routing chips or devices and connectors. In this example,a first input/output port on a first routing device may be connected topins of a second lane on a first connector and a second input/outputport on the first routing device may be connected to pins of a secondlane on a second connector. Similarly, a first input/output port on asecond routing device may be connected to pins of a first lane on afirst connector and a second input/output port on the second routingdevice may be connected to pins of a first lane on a second connector.

The above description of embodiments of the invention has been presentedfor the purposes of illustration and description. It is not intended tobe exhaustive or to limit the invention to the precise form described,and many modifications and variations are possible in light of theteaching above. The embodiments were chosen and described in order tobest explain the principles of the invention and its practicalapplications to thereby enable others skilled in the art to best utilizethe invention in various embodiments and with various modifications asare suited to the particular use contemplated. Thus, it will beappreciated that the invention is intended to cover all modificationsand equivalents within the scope of the following claims.

What is claimed is:
 1. A method of transferring data among a pluralityof electronic devices, the method comprising: receiving first data at afirst routing circuit of a first electronic device; receiving seconddata at a second routing circuit of the first electronic device;providing the first data using the first routing circuit to one of afirst electronic circuit of the first electronic device, a second set ofpins of a first connector of the first electronic device, or a secondset of pins of a second connector of the first electronic device; andproviding the second data using the second routing circuit to one of afirst set of pins of the first connector of the first electronic deviceor a first set of pins of the second connector of the first electronicdevice, wherein the first connector and the second connector of thefirst electronic device are the same type of connector, each havingcorresponding pins in corresponding positions for a first lane and eachhaving corresponding pins in corresponding positions for a second lane,the first set of pins of the first connector for a first lane of thefirst connector, the first set of pins of the second connector for afirst lane of the second connector, the second set of pins of the firstconnector for a second lane of the first connector, and the second setof pins of the second connector for a second lane of the secondconnector, and wherein the first routing circuit of the first electronicdevice provides the first data to a second set of pins of a firstconnector of the first electronic device using an input/output port. 2.The method of claim 1 wherein the first data and second data includeThunderbolt data.
 3. The method of claim 2 wherein the first electronicdevice is a display device.
 4. The method of claim 3 wherein the firstconnector may connect to a hard drive.
 5. The method of claim 1 whereinthe first data and the second data are received by the first routingcircuit and the second routing circuit using a first physical cable. 6.The method of claim 5 wherein the first physical cable is a tetheredcable.
 7. The method of claim 5 wherein the first data and the seconddata include PCIe data in a Thunderbolt tunnel.
 8. An electronic devicecomprising: a first connector; a second connector, wherein the firstconnector and the second connector are the same type of connector, eachhaving corresponding pins in corresponding positions for a first laneand each having corresponding pins in corresponding positions for asecond lane; a first routing circuit coupled to receive data and havinginput/output circuitry coupled to pins for the second lane in the firstconnector and pins for the second lane in the second connector; a secondrouting circuit coupled to receive data and having input/outputcircuitry coupled to pins for the first lane in the first connector andpins for the first lane in the second connector; and a first electroniccircuit coupled to the first routing circuit.
 9. The electronic deviceof claim 8 wherein the first routing circuit is configured to receivefirst data and to provide the first data to one of the first electroniccircuit, pins for the second lane in the first connector, or pins forthe second lane in the second connector.
 10. The electronic device ofclaim 9 wherein the second routing circuit is configured to receivesecond data and to provide the second data to one of the pins for thefirst lane in the first connector, or pins for the first lane in thesecond connector.
 11. The electronic device of claim 10 wherein thefirst data and second data include Thunderbolt data.
 12. The electronicdevice of claim 8 wherein the electronic device is a display device. 13.The electronic device of claim 12 wherein the first connector mayconnect to a hard drive.
 14. The electronic device of claim 8 whereinthe data is received by the first routing circuit and the second routingcircuit using a first physical cable.
 15. The electronic device of claim14 wherein the first physical cable is a tethered cable.
 16. Theelectronic device of claim 14 wherein the data includes PCIe data in aThunderbolt tunnel.
 17. The electronic device of claim 14 wherein datafor the first routing circuit is conveyed in a first lane of the firstphysical cable and data for the second routing circuit is conveyed in asecond lane of the first physical cable.
 18. The electronic device ofclaim 17 wherein the first lane and the second lane of the firstphysical cable correspond to specific conductors in the first physicalcable.
 19. The electronic device of claim 8 wherein the first connectorand the second connector are Thunderbolt connectors.